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Abstract 

In  this  note  we  show  that  instances  of  problems  which 
appear  naturally  in  computer  science  cannot  be  answered  in 
formalized  set  theory.  We  show,  for  example,  that  some 
relativized  vei jions  of  the  famous  P = NP  problem  cannot  be 
answered  in  formalized  set  theory,  that  explicit  algorithms 
can  be  given  whose  running  time  is  independent  of  the  axioms 
of  set  theory,  and  that  one  can  exhibit  a specific  context-free 
grammar  G for  which  it  cannot  be  proven  in  set  theory  that 


L (G)  = E*  or  L (G)  ^ E*. 
1.  ^^ntroduction 


During  the  last  few  years  research  in  theoretical  com- 
puter science  has  identified  several  problems  whose  solution 
seems  to  be  important  for  the  further  development  of  the  field 
and  on  which  a considerable  amount  of  research  effort  has  been 


*This  research  has  been  supported  in  part  by  National  Science 
Foundation  Research  Grant  DCR  75-09433  and  the  Office  of  Naval 
Research  under  Grant  N00014-76-C-0018 . 
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In  spite  of  all  this  effort  these  problems 


remain  unsolved  and D though  we  understand  them  much  better 
now,  no  real  progress  seems  to  have  been  made  toward  their 

k t 

solution.  Nevertheless,  there  remains  real  optimism  that 
they  will  be  solved  and  a deeply  ingrained  conviction  that 
they  can  be  solved,  j As  a matter  of  fact,  for  the  famous 
P = NP  problem,  bets  have  been  placed  whether  P = NP  or  P / NP 
with  strong  convic/tion  that  they  will  eventually  be  collected. 
Similarly,  there?  is  a strong  conviction  that  with  sufficient 
effort  and  cleverness  the  running  time  of  any  specific  algo- 
rithm ca^  be  determined. 

In  ^his  note  point$  out  that  many  of  these  problems 

may  not  have  a solution  in  formalized  mathematical  systems; 

t-f 

more  specifically,  wc  pygve  'that  the  solutions  of  many  in- 
stances of  these  problems  are  independent  of  the  axioms  of 
set  theory  f-3"]  . Indeed,  we  show  that  there  exist  relativized 
versions  of  the^^  = NP  problem  which  cannot  be  answered  in 
formalized  set  theory,  that  explicit  algorithms  can  be  given 
whose  running  time  is  independent  of  the  axioms  of  set  theory 

I 

and  show  in  general  that  many  other  instances  of  problems  in 
computer  science  cannot  be  answered  in  formalized  set  theory. 

More  precisely,  for  a set  A,  Ac  £*,  let  PA  be  the  class 
of  languages  accepted  in  polynomial-time  by  deterministic 
Turing  machines  with  the  oracle  set  A and  let  NPA  be  the 
corresponding  class  of  languages  accepted  in  polynomial-time 
by  nondeterministic  Turing  machines  with  the  oracle  set  A. 
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We  know  [2]  that  there  exist  recursive  sets  B and  C such  that 
P = NP  and  P ^ NP  . Using  this  result  we  explicitly  con- 
struct a recursive  set  A and  show  that  it  is  independent  of 

A A A A 

•the  axioms  of  set  theory  whether  P = NP  or  P ^ NP  . 

Unfortunately,  this  result  shows  only  that  there  exist 

relativized  instances  of  this  problem  which  cannot  be  solved 

in  the  framework  of  formal  set  theory,  it  does  not  say  anything 

directly  about  the  classic  P = NP  problem.  On  the  other  hand, 

we  can  show  that  there  are  other  specific  algorithms  whose 

running  time  is  independent  of  the  axioms  of  set  theory.  We 

explicitly  construct  an  algorithm  such  that  it  is  consistant 

with  the  axioms  of  set  theory  to  assume  that  it  runs  in  time 
2 xi 

n or  2 . The  algorithm  can  be  seen  (outside  of  formal  set 

2 

theory)  to  run  in  time  n but  there  is  no  proof  in  formalized 
set  theory  that  this  is  the  case,  no  bound  lower  than  2n  can 
be  formally  proven. 

The  same  reasoning  shows  that  many  instances  of  questions 
about  context-free  languages  and  automata  are  independent  of 
the  axioms  of  set  theory.  For  example,  v/e  construct  a contcxt= 
free  grammar  G such  that  there  is  no  proof  in  set  theory  that 
L (G)  = E*  or  L (G)  ? E* . 

Looking  at  problems  in  computer  science,  with  these  re- 
sults in  mind,  we  have  to  conclude  that  many  different  problems 
which  appear  naturally  in  computer  science  will  have  specific 
instances  which  cannot  be  answered  by  standard  mathematical 
methods  since  they  are  independent  of  the  axioms  and  formal 

^ ■ ■ - , - ■**--  _ _ 
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reasoning  used  in  most  of  mathematics.  It  seems  particularly 
surprising  that  this  already  happens  in  the  analyses  of 
running  times  of  algorithms. 

It  should  be  pointed  out  that  similar  results  are  known 
in  some  parts  of  pure  mathematics  but  they  do  not  seem  to  be 
as  prevalent  as  in  computer  science  problems.  This  is  caused 
by  the  difference  in  the  problem  areas:  in  computer  science 

we  deal  with  computations,  with  devices  which  perform  these 
computations  and  with  properties  of  computations.  In  all 
these  cases  we  can  embed  "universal"  computations  and  "self= 
referencing"  in  these  problems  and  thus  reach  instances  of 
problems  which  cannot  be  answered  in  formal  mathematical  sys- 
tems. On  the  other  hand,  in  many  parts  of  mathematics  either 
such  embeddings  and  self-references  do  not  exist  or  are  ex- 
tremely hard  to  find.  For  example,  the  solution  of  Hilbert's 
tenth  problem  [7]  is  recognized  as  a great  achievement  mainly 
because  the  embedding  of  universal  computations  in  diophantine 
equations  was  exceedingly  difficult.  Once  this  embedding  is 
known,  one  can  easily  show  that  there  exist  diophantine 
equations  for  which  there  exist  (integer)  solutions  but  that 
their  existence  is  independent  of  the  axioms  of  set  theory. 

It  is  to  be  expected  that  results  of  this  type  will  be 
found  in  other  parts  of  mathematics.  In  general  though,  we 
have  to  expect  that  this  will  not  permiate  mathematical  re- 
search areas.  The  situation  in  computer  science  is  quite 
different,  as  stated  before,  the  central  object  of  study  in 
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this  science  is  computation  which  unavoidably  brings  with  it 
instances  of  problems  which  cannot  be  solved  by  traditional 
mathematical  methods. 


2.  The  P = NP  Problem 

We  now  turn  to  the  problem  of  exhibiting  a recursive  set 
A A 

A such  that  P = NP  is  independent  of  the  axioms  of  set  theory, 

Let  F be  any  formal  mathematical  system  for  proving 

theorems.  We  assume  that  F is  axiomatizable  (i.e.  that  the  set 

of  provable  theorems  is  recursively  enumerable) , that  F is 

consistant,  that  the  provable  theorems  are  intuitively  true 

and  that  F is  of  sufficient  power  to  prove  the  basic  theorems 

of  set  theory.  Let  { <^  1 , <j>2/  . ..)  he  an  acceptable  enumeration 

of  all  one- tape  Turing  machines.  Thus  we  know  that  the  Smn 

and  recursion  theorems  hold  for  this  enumeration  [8] . Further- 

♦ i *i 

more,  for  the  sake  of  brevity,  we  will  write  P and  NP  , re- 

A A 

spectively,  for  P and  NP  provided  4>^  accepts  the  set  A.  Let 
'O'  denote  convergence  and  IT  divergence  of  algorithms. 

Theorem;  For  every  F we  can  effectively  construct  an  i such 

♦ i 

that  <j>,  is  recursive  and  the  relativized  P = NP  is  mde- 

<f> . 4> . 

pendent  of  F.  That  is  P 1 = NP  1 can  neither  be  proved  nor 
disproved  in  F. 

• B B 

Proof : Let  B and  C be  recursive  sets  such  that  P = NP  and 

c c 

P / NP  . From  [2]  we  know  that  such  sets  exist  and  are 


effectively  constructable.  Define 
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4>(x,j)  = 


r ^ if  there  exists  a proof  among 

the  first  x proofs  in  F that 
^ • <f>. 

P = NP  and  x e C or  if  there 
exists  a proof  among  the  first 
x proofs  in  F that  P ^ NP 


and  x e B 
^ otherwise 

Now  by  the  Smn  theorem  there  exists  a recursive  a such  that 

4>a  (j)  M = 4 (x,  j)  . 

By  the  recursion  theorem  there  exists  io  such  that 

(x)  = . x (x) . 

io  o Ho J 

Thus 

4>.  (x)  = <f>  (x,  i0 ) . 

10  <j> . <p . 

If  there  is  a proof  in  F that  P lo  = NP  lQ,  then  the  set 

accepted  by  <f>  ■ differs  at  most  finitely  from  C and  hence  we 

4»  - ln  ’ 

know  P 10 

♦i, 


r j 

^ NP  °.  Similarly  if  there  is  a proof  in  F that 
4* . 

^ NP  10 , then  the  set  accepted  by  <j>.  differs  at  most 


finitely  from  B and  hence  P lo  = NP 


+ i, 


io 

Since  F is  such  that 


any  theorem  proved  in  F is  intuitively  true  we  conclude  that 


there  can  be  no  proof  of  either  P lo  = NP  lo  orP  NP  1(3 

in  F.  Thus  whether  or  not  P 0 = NP  0 is  independent  of  the 
formal  mathematical  system  F.  □ 

Intuitively  we  know  that  «J> . in  the  above  construction  ac- 

4> . 1 $ . 

cepts  the  empty  set  and  P 1 = NP  1 is  true  if  and  only  if 
P = NP  in  the  classical  version.  Still  it  does  not  follow  from 
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this  proof  that  the  unrelativized  version  is  not  provable  in 
set  theory.  What  we  have  just  proven  suggests  the  possibility 
that  the  unrelativized  P = NP  problem  could  be  independent  of 
the  axioms  of  set  theory.  It  may  be  possible  to  have  two  com- 
pletely consistent  theories  of  computation,  one  in  which  P = 

NP  is  an  axiom  and  the  other  in  which  P / NP  is  an  axiom. 

3.  Analysis  of  Algorithms  and  Other  Problems 

Next  we  exhibit  an  algorithm  which  cannot  be  analyzed 

in  the  sense  that  its  running  time  is  independent  of  the 

axioms  of  F.  Blum's  speed  up  theorem  [4]  shows  that  there 

are  functions  with  no  best  algorithm.  What  we  are  saying  is 

something  entirely  different.  There  are  algorithms  with 

definite  running  times  which  are  not  provable  in  set  theory. 

In  particular  we  will  exhibit  an  algorithm  which  runs  in  time 
2 

n , but  for  which  there  is  no  proof  in  F of  an  upper  bound 

less  than  2n  nor  is  there  a proof  in  F of  a lower  bound  greater 
2 

than  n . Consequently  formal  mathematics  is  not  powerful 
enough  to  analyze  all  algorithms. 

To  do  this  we  first  prove  a lemma. 

Lemma : Given  the  formal  system  F we  can  exhibit  an  i such  that 

^1*1 

the  halting  of  the  i—  Turing  machine  when  started  on  blank 
tape  cannot  be  proved  or  disprgved  in  F. 

Proof ; Let  ^^(-)  denote  the  i—  Turing  machine  with  blank  in- 
put tape.  Define 
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'V'if  there  exists  a proof  in  F 
that  $ j (-)IT 

“fl*  otherwise 

Again  by  the  Smn  and  recursion  theorems  there  exist  a and  ig 
such  that 

4>(x, j)  = 4>a(j)  00 

and 


<f>,  (x)  = A ..  , (x)  . 
lo  o \Xq) 

By  a meta  argument  we  conclude  that  (-)  does  not  halt,  since 

if  «j>.  (-)  halts  then  there  cannot  be  a proof  in  F that  4>.  iT , 

3-0  -L  0 

which  is  the  only  way  <f> . (-)  can  halt.  Thus  there  is  no  proof 

in  F that  <p . (-)  does  not  halt  nor  can  there  be  a proof  in  F 
x0 

that  it  does  halt.  □ 


Clearly  we  already  knew  of  the  existence  of  the  i satis- 
fying the  last  theorem.  A proof  in  F for  each  i that  <f>^  did 
or  did  not  halt  would  imply  that  { i | (-) 'll } was  recursive. 

What  the  lemma  shows  is  that  we  can  effectively  exhibit  a 
specific  Turing  machine  which  does  not  halt  on  blank  tape  but 
for  which  there  is  no  proof  of  this  fact  in  F. 

We  now  show  that  some  algorithms  with  well  defined  running 
times  cannot  be  analyzed  in  F. 

To  reveal  the  simplicity  of  this  proof  we  make  an  addi- 
tional assumption  about  the  formal  system  F,  as  described  below. 
This  assumption  is  not  essential  for  ,the  next  result,  but  with- 
out it  our  proofs  become  considerable  longer,  since  we  have  to 
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show  that  the  application  of  the  Smn  and  recursion  theorems 

in  this  proof  do  not  change  the  running  times  of  algorithms 

drastically.  This  can  be  done,  but  for  the  sake  of  brevity, 

kwe  are  omitting  this  longer  proof. 

For  any  j let  be  a Turing  machine  which  for  input 

n simulates  <p ^ (-)  for  n steps  and  if  <J>j  (-)  has  not  halted  in 

2 

n steps  (n)  halts  in  exactly  n steps;  if  <J>j  (-)  does  halt 

in  n steps  then  (n)  halts  in  exactly  2n  steps. 

We  assume  that  there  is  a construction  p , as  described 
above,  such  that  we  can  prove  in  F for  all  j that: 

^p(j)  runs  *-ime  < 2n  iff  <J>j  (~)  does  not  halt. 


Theorem:  There  exists  an  algorithm  (which  can  be  explicitly 

2 

given)  whose  running  time  is  n , but  there  is  no  proof  m F 
that  it  runs  in  time  < 2n. 

Proof:  Let  in  be  an  index  such  that  <f> . (-)  does  not  halt  and 

u J-o 

for  which  there  is  no  proof  in  F tha+-  <{> . (-)  does  not  halt;  our 

x0 

previous  corollary  guarantees  that  we  can  effectively  obtain 

such  ip.  Then,  from  our  assumptions  about  F,  it  follows  that 

there  is  no  proof  in  F that  6 , . . runs  in  time  < 2n  since 

pUo) 

this  would  prove  in  F that  <{>•  (-)  does  not  halt.  Thus  <|> 

•**0  P v ) 

2 

is  an  algorithm  running  in  time  n for  which  there  is  no  proof 
in  F that  it  runs  in  time  less  than  2n.  □ 

A similar  proof  yields  the  following  result. 

Corollary:  There  exists  an  algorithm  <J» ^ which  runs  in  time 

Do 


1 
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2 

n but  for  which  there  is  no  proof  in  F that  it  is  a total 
function,  thus  no  running  time  bound  can  be  proven  for  4^ 
in  F. 

Next  we  show  that  simple  problems  about  context-free 
languages  are  independent  of  the  axioms  of  F,  provided  we  can 
prove  in  F elementary  facts  about  context-free  languages. 

Theorem:  One  can  exhibit  a context-free  grammar  G such  that 

L(G)  = E*  but  for  which  there  is  no  proof  in  F that  L(G)  = E* 
or  L (G)  1 E*. 

Proof : Using  standard  techniques  [6]  given  i one  can  construct 

G^  such  that  L (G^ ) = E*  iff  <J>^(-)/fr.  Furthermore,  if  F is 

sufficiently  rich,  a proof  in  F that  L(G^)  does  or  does  not 

equal  E*  can  be  extended  to  a proof  in  F that  <j’^  does  or  does 

not  converge.  But  then  using  an  io  for  which  there  is  no 

proof  that  <{> . (-)  /fT,  we  get  a G.  = E*  but  there  is  no  proof 
3-0  3-0 

in  F that  L(G.  ) = E*  or  L (G . ) ^ E*.  0 

^■0  io 

Corollary : One  can  exhibit  a specific  recursive  function  t 

such  that  the  equality  of  the  time  complexity  classes  and 
Cfc2  is  independent  of  F. 

Proof:  Similar  to  the  previous  proof.  0 

4 . Conclusion 

These  results  are  presented  not  as  something  new  or  pro- 
found but  only  as  a caution  to  computer  scientists  working  in 


complexity,  lower  bounds,  analysis  of  algorithms,  and  related 
topics.  One  should  recognize  that  due  to  the  self-referencing 
ability  of  our  formalisms  we  can  reformulate  Godel's  incom- 
pleteness theorem  in  computer  science  problems.  Thus  given 
set  theory  or  any  other  formal  theory  there  are  many  specific 
instances  of  problems  with  which  we  are  concerned  but  which 
are  independent  of  the  theory.  What  this  suggests  is  that  our 
inability  to  settle  questions  like  the  P = NP  problem  or  prove 
lower  bounds  may  be  a consequence  of  the  power  (or  weakness) 
of  formal  systems  such  as  set  theory.  Clearly  an  exciting  re- 
sult would  be  to  discover  a natural  instance  of  such  a problem. 
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